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Abstract 

We search for lepton-flavor-violating r decays into three leptons (electron or muon) using 535 
fb~^ of data collected with the Belle detector at the KEKB asymmetric-energy e^e~ collider. No 
evidence for these decays is observed, and we set 90% confidence level upper limits on the branching 
fractions of (2.0 — 4.1) x 10~^. These results improve upon our previously published upper limits 
by factors of 4.9 to 10. 

PACS numbers: ll.30.Fs; 13.35.Dx; 14.60.Fg 



INTRODUCTION 

Lepton flavor violation (LFV) appears in various extensions of the Standard Model (SM). 
In particular, lepton-flavor-violatingdecays r~ — *■ £~£~^i~ (where £ = e or /x ) [|] are discussed 
in various supersymmetry models |l|, |2, y, U, la, Ig, |7|], models with little Higgs |8|, 9|[, left- 
right symmetric models [lO|, as well as models with heavy singlet Dirac neutrinos ll| and 
very light pseudoscalar bosons 12|. Some of these models with certain combinations of 
parameters predict that the branching fractions for r~ -^ i~i'^i~ can be as high as 10"''', 
which is already accessible in high-statistics B factory experiments. Searches for LFV r 
decays into three leptons have a long history [13|] beginning from the pioneering experiment 
of MARKII [ij]. In previous analyses, both Belle and BaBar reached 90% confidence level 



(CL.) upper limits on the branching fractions at the 10 ^ level |l5l . Il6|, based on about 



90 fb ^ of data. The BaBar collaboration has recently used 376 fb ^ of data to obtain 



90% CL. upper limits in the range (3.7—8.0) x 10~^ [17|. Here, we update our previous 
results with a much larger data set (535 fb~^) collected with the Belle detector at the KEKB 
asymmetric-energy e^e~ collider 18|, taken at the T(4S') resonance and 60 MeV below it. 



The Belle detector is a large-solid-angle magnetic spectrometer that consists of a silicon 
vertex detector (SVD), a 50-layer central drift chamber (CDC), an array of aerogel threshold 
Cherenkov counters (ACC), a barrel-like arrangement of time-of-fiight scintillation counters 
(TOP), and an electromagnetic calorimeter comprised of CsI(Tl) crystals (ECL), all located 
inside a superconducting solenoid coil that provides a 1.5 T magnetic field. An iron fiux- 
return located outside the coil is instrumented to detect i^L mesons and to identify muons 
(KLM). The detector is described in detail elsewhere 191 . 



Leptons are identified using likelihood ratios calculated from the response of various 
subsystems of the detector. For electron identification, the likelihood ratio is defined as 
V{e) = Lei {He + -^x), where He and L^ are the likelihoods for electron and non-electron, 
respectively, determined using the ratio of the energy deposit in the ECL to the momentum 
measured in the SVD and CDC, the shower shape in the ECL, the matching between the 
position of the charged track trajectory and the cluster position in the ECL, the hit informa- 
tion from the ACC, and the dE/dx information in the CDC [20|. For muon identification, 
the likelihood ratio is defined as V^ji) = C^/{C^ + Ct, + j^k), where C^, £^ and Ck are 
the likelihoods for the muon, pion and kaon hypotheses, respectively, based on the matching 
quality and penetration depth of associated hits in the KLM [2 11 ]. 

In order to estimate the signal efficiency and to optimize the event selection, we use Monte 
Carlo (MC) samples. The signal and the background events from generic t~^t~ decays are 
generated by KKMC/TAUOLA [2^. In the signal MC, we generate t^t~ , where a r decays 
into three leptons using a 3-body-phase-space model |23|], and the other r decays generically. 
Other backgrounds, including BB and e+e~ ^ qq {q = u, d, s, c) events, Bhabha events, 
e~^e~ -^ l^^ ^^~ 1 and two-photon processes are generated by EvtGen [2J], BHLUMI J25|, 



KKMC and AAFH [26|, respectively. All kinematic variables are calculated in the laboratory 
frame unless otherwise specified. In particular, variables calculated in the e^e~ center-of- 
mass (CM) system are indicated by the superscript "CM". 



[t] Throughout this paper, charge-conjugate modes are imphed unless stated otherwise. 



EVENT SELECTION 

We search for t^t^ events in which one r (the signal r) decays into three leptons, and 
the other r (the tag r) decays into one charged track, any number of additional photons and 
neutrinos. Candidate r-pair events are required to have four tracks with zero net charge. 
The following final states are considered: e~e"'"e~, fi~fi~^fi~, e'/i"*"//", fi~e~^e~ , /i~e"'"/i~, and 
e~n~^e~. The event selection is optimized mode- by-mode since the backgrounds are mode 
dependent. 

The event selection starts by reconstructing four charged tracks and any number of pho- 
tons within the fiducial volume defined by —0.866 < cos 6 < 0.956, where 9 is the polar angle 
relative to the direction opposite to that of the incident e"*" beam in the laboratory frame. 
The transverse momentum (pt) of each charged track and the energy of each photon (E^) 
are required to satisfy pt > 0.1 GeV/c and i^^^ > 0.1 GeV, respectively. For each charged 
track, the distance of the closest point with respect to the interaction point is required to 
be less than ±0.5 cm in the transverse direction and less than ±3.0 cm in the longitudinal 
direction. 

Using the plane perpendicular to the CM thrust axis [27|, which calculated from the 
observed tracks and photon candidates, we separate the particles in an event into two hemi- 
spheres. These are referred to as the signal and tag sides. The tag side contains one charged 
track while the signal side contains three charged tracks. We require all charged tracks on 
the signal side to be identified as leptons. The electron (muon) identification criteria are 
V{e) > 0.9 {V{fi) > 0.9) and momentum greater than 0.3 GeV/c (0.6 GeV/c). The electron 
(muon) identification efficiency is 91% (85%) while the probability to misidentify a pion as 
an electron (a muon) is below 0.5% (2%). 

To ensure that the missing particles are neutrinos rather than photons or charged particles 
that pass outside the detector acceptance, we impose requirements on the missing momentum 
Pmiss, which is calculated by subtracting the vector sum of the momenta of all tracks and 
photons from the sum of the e^ and e~ beam momenta. We require that the magnitude of 
Pmiss be greater than 0.4 GeV/c, and that its direction point into the fiducial volume of the 
detector. 

To reject qq background, we require that the magnitude of thrust (T) be 0.90 < T < 
0.97 for all modes except for the r~ -^ e~e^e~ mode, for which it is 0.90 < T < 0.96. We 
also require 5.29 GeV < E^^ < 9.5 GeV, where E^^ is the total visible energy in the CM 
system, defined as the sum of the energies of the three leptons, the charged track on the tag 
side (with a pion mass hypothesis), and all photon candidates. 

Since neutrinos are emitted only on the tag side, the direction of pmiss should lie within the 
tag side of the event. The cosine of the opening angle between Pmiss and the charged track on 
the tag side in the CM system, cos 6'fj^g_jjjjss, is required to lie in the range 0.0 < cos 6'^ag-miss < 
0.98. This upper limit reduces background from Bhabha, /i^/i~ and two-photon background 
events, as radiated gammas from the tag-side track result in missing momentum if they 
overlap with the ECL clusters of the tag-side track |28|. The reconstructed mass on the tag 
side using a charged track (with a pion mass hypothesis) and photons, mtag? is required to 
be less than 1.777 GeV/c^. As shown in Fig. [H reasonable agreement between data and the 
background expectation from MC simulation is obtained in the distributions of cos ^fag-miss 
and mtag. 

Conversions (7 -^ e~^e~) are a large background for the r~ —>■ e~e~^e~ and /x~e+e~ modes. 
For these modes, if the invariant mass of the e^e~ pair (Mee) is less than 0.2 GeV/c^, we 
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FIG. 1: Kinematic distributions used in the event selection: (a) the cosine of the opening angle 
between a charged track on the tag side and missing particles in the CM system (cos0{^¥_j^-gg); (b) 
the reconstructed mass on the tag side using a charged track and photons after E^^ and T event 
selection. The signal MC (t~ — ;■ fi~fi~^fi~) distributions with arbitrary normalization are shown 
for comparison; the background MC distributions are normalized to the data luminosity. Selected 
regions are indicated by the arrows from the marked cut boundaries. 
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FIG. 2: Scatter-plots of the reconstructed invariant mass of the e~^e~ pair (Mge) vs. cosine of the 
opening angle between the direction of the e^ 
data, (b) Bhabha and eeee, (c) signal MC (r" 



opening angle between the direction of the e+e pair and the other electron (cos0{^^Q^_j,p) for (a) 
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require that the cosine of the opening angle in the CM system between the momentum of the 
e~^e~ pair and the momentum of the other lepton {cos 9^^^^_^^) be less than 0.90. As shown 
in Fig. [2] for the r~ —* e~e^e~ mode (two entries for each event), the signal efficiency is not 
affected by this cut, while the large background from conversions is substantially reduced. 

For the r~ —> e~e~^e~ and r~ -^ e~yU+/i~ modes, the charged track on the tag side is 
required not to be an electron by applying 'P(e) < 0.1; this reduces large backgrounds from 
two-photon and Bhabha processes that remain. Furthermore, we reject the event if the 
charged track on the tag side traverses the gap between the barrel and the endcap of the 
ECL. To reduce Bhabha and fi~^fi~ backgrounds, we require that the momentum in the CM 



TABLE I: The selection criteria for the missing monientum (pmiss) and missing mass squared 
(m^jgg) for each mode, The units for Pmiss and m'^^^^ are GeV/c and (GeV/c^)^, respectively. 



Mode 


Hadronic tag mode 


Leptonic tag mode 




Pmiss > -3.0 m^i3s - 1.0 
Pmiss > 3.0 m^jg, - 1.5 


Pmiss > — 2.5 Wl^iss 
Pmiss > 1-3 m^i,, - 1 


T~ -^ e~e^e~ 


Pmiss > -3.0 m^i,, - 1.0 
Pmiss > 4.2 m^i^g - 1.5 


Pmiss > — 2.5 m-j^igg 

Pmiss > 2.0 m^igg - 1 




Not applied 


Not applied 



TABLE IL Summary of Afg^ and A^ resolutions. The a^'^^ (ct'°^) 
on the higher (lower) side of the peak. 



means the standard deviation 



Mode 


high 


(MeV/c2) 


low 


(MeV/c2) 


a^f (MeV) 


^'Ke (MeV) 


r^ 


^ fl fl+fl 




4.8 




5.4 


12.5 


15.7 


T~ 


-^ e~e'^e~ 




5.1 




7.8 


13.4 


25.1 


T~ 


-^ e~fi~^fi~ 




5.1 




5.6 


12.1 


19.6 


T~ 


— > fi~e'^e' 




5.0 




6.6 


13.4 


21.3 


T~ 


-^ e~^IJ,~fi~ 




5.0 




6.0 


13.3 


19.9 


T~ 


-^ IJ.^e~e~ 




5.4 




6.7 


13.8 


23.0 



system of the charged track on the tag side be less than 4.5 GeV/c for the r^ -^ e~e^e~ 
and r~ — s- /i~e+e~ modes. 

Finally, to suppress backgrounds from generic t^t~ and qq events, we apply a selection 
based on the magnitude of the missing momentum Pmiss and the missing mass squared rn^^gg 
for all modes except for r^ -^ e^fi^fi^ and /i+e~e~. We do not apply this cut for the latter 
two modes since backgrounds in these cases are much smaller. We apply different selection 
criteria according to the lepton identification of the charged track on the tag side, as the 
number of emitted neutrinos is two if the track is an electron or muon (leptonic tag) while 
it is one if the track is a hadron (hadronic tag). The selection criteria are listed in Tabled 
the distributions of m^jgg and Pmiss for hadronic and leptonic decays are shown in Fig. [31 



SIGNAL AND BACKGROUND ESTIMATION 



The signal candidates are examined in the two-dimensional plot of the i~£^i~ invariant 
mass (M^i) versus the difference of their energy from the beam energy in the CM sys- 
tem (AE'). A signal event should have M^i close to the r-lepton mass and AE close to zero. 
For all modes, the M^i and AE resolutions are parameterized from fits to the signal MC 
distributions, with an asymmetric Gaussian function that takes into account initial-state 
radiation. The resolutions in M^e and AE for each mode are summarized in Table [TTl 
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FIG. 3: Scatter-plots of pmiss vs. "i^jg^: (a) and (b) show the signal MC (r~ -^ ij.~fi.^fj.~) and 
the generic t~^t~ MC distributions, respectively, for the hadronic tags while (c) and (d) show the 
same distributions for the leptonic tags. Selected regions are indicated by lines. 



To evaluate the branching fractions, we use elliptical signal regions that contain 90% of 
the MC signal events satisfying all selection criteria. We blind the data in the signal region 
until all selection criteria are finalized so as not to bias our choice of selection criteria. 
Figure H] shows scatter-plots for the data and the signal MC distributed over ±20cr in the 
Msi — AE plane. No events are observed outside the signal region for any modes except 
for r~ -^ e~e^e~, in which four events are found. These remaining events all have e+e~ 
invariant masses below 0.1 GeV/c^, and we nominally attribute them to Bhabha electron 
or T~ -^ e'^T-Ve processes accompanied by a gamma conversion. The final estimate of 
background is based on the data with looser selection criteria for particle identification 
and event selection in the Ma^ sideband region. The sideband region is defined as the box 
inside the horizontal lines but excluding the signal region, as shown by the lines in Fig. 01 
Assuming that the background distribution is uniform in the sideband region, the number 
of background events in the signal box is estimated by interpolating the number of observed 
events in the sideband region into the signal region. The signal efficiency and the number of 
expected background events for each mode are summarized in Table IIIII After estimating 
the background, we unblind and find no candidate events for any of the modes. 

We estimate systematic uncertainties due to lepton identification, charged track finding, 
MC statistics, and integrated luminosity. The uncertainty due to the trigger efficiency is 
negligible compared with the other uncertainties. The uncertainties due to lepton identifi- 
cation are 2.2% per electron and 2.0% per muon. The uncertainty due to the charged track 



TABLE III: The signal efficiency(e), the number of the expected background events (A'bg) esti- 
mated from the sideband data, total systematic uncertainty (osyst), the number of the observed 
events in the signal region (A'^obs)) 90% C.L. upper limit on the number of signal events including 
systematic uncertainties (sgo) and 90% C.L. upper limit on the branching fraction (B) for each 
individual mode. 



Mode 


e{%) 


Abg 


0"syst (%) 


Aobs 


sgo 


B{ 


xlO-8) 


T~ 


-^ e e+e 


6.00 


0.40±0.30 


9.8 





2.10 




3.6 


T~ 


-^ /^~Ai+/-f" 


7.64 


0.07±0.05 


7.4 





2.41 




3.2 


T~ 


-^ e~i-i^fi~ 


6.08 


0.05±0.03 


9.5 





2.44 




4.1 


T~ 


-^ /i~e"'"e~ 


9.29 


0.04±0.04 


7.8 





2.43 




2.7 


T~ 


-^ e+^^l^r 


10.8 


0.02±0.02 


7.6 





2.44 




2.3 


T~ 


— > /i^e^e^ 


12.5 


O.OliO.Ol 


7.7 





2.46 




2.0 



finding is estimated to be 1.0% per charged track. The uncertainty due to the e-veto on 
the tag side applied for the r~ — > e~e~^e~ and r~ — > e~/i"'"/i~ modes is estimated to be the 
same as the uncertainty due to the electron identification. The uncertainties due to MC 
statistics and luminosity are estimated to be (0.5 - 0.9)% and 1.4%, respectively. All these 
uncertainties are added in quadrature, and the total systematic uncertainty for each mode 
is listed in Table IIIII 



UPPER LIMITS ON THE BRANCHING FRACTIONS 

We set upper limits on the branching fractions of r~ -^ i~i~^i~ based on the Feldman- 
Cousins method 29|. The 90% C.L. upper limit on the number of the signal events and 
including a sy stematic uncertainty (sgo) is obtained using the POLE program without con- 
ditioning 30| based on the number of expected background events, observed data and the 



systematic uncertainty. The upper limit on the branching fraction [B) is then given by 



B{r- 



< 



S90 

2Nrre '' 



(1) 



where A',-,- is the number of r^r^pairs, and e is the signal efficiency. The value N^^ = 492 x 
10^ is obtained from the integrated luminosity times the cross section of r-pair production, 
which is calculated in the updated version of KKMC [3l| to be arr = 0.919 ± 0.003 nb. The 
90% C.L. upper limits on the branching fractions B{t~ -^ i~i~^i~) are in the range between 
2.0 X 10~^ and 4.1 x 10~^ and are summarized in Table UTTl These results improve upon our 
previously published upper limits [l5| by factors of 4.9 to 10. They are also more stringent 
upper limits than the recent BaBar results 



ITj, except for the r ^ e ^~^fi mode, for 



which the limit is similar. 



SUMMARY 



We have searched for lepton-flavor-violating r decays into three leptons using 535 fb ^ of 
data. No events are observed and we set 90% C.L. upper limits on the branching fractions: 
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FIG. 4: Scatter-plots in the M^i - AE plane: (a), (b), (c), (d), (e) and (f) correspond to the 
±20(7 area for the t~ -^ e~e~^e~, r~ — > fi^fi^fi^, r" — > e~/i+/i~, r" — s- /x^e+e", r~ — s- e~^fi~fi~ 
and T~ ^ /x'^e~e~ modes, respectively. The data are indicated by the solid circles. The filled 
boxes show the MC signal distribution with arbitrary normalization. The elliptical signal regions 
shown by a solid curve are used for evaluating the signal yield. The region between the horizontal 
solid lines excluding the signal region is used to estimate the expected background in the elliptical 
region. 



B{t- -^ e-e+e") < 3.6 x 10-^ ^(r" -^ fi-fi+fi-) < 3.2 x 10-^ i3(r- -^ e-fi+fi-) < 
4.1 X 10^^ i3(r- ^ /i^e+e^) < 2.7 x 10-^ ;B(r- ^ e+/i>^) < 2.3 x lO^^ and 8{t~ -^ 
fi~^e~e~) < 2.0 X 10~®. These results improve upon our previously published upper limits by 
factors of 4.9 to 10. These more stringent upper limits can be used to constrain the space 
of parameters in various models of new physics. 
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